Papers with commercial search engine
Lexicon-Enhanced Self-Supervised Training for Multilingual Dense Retrieval (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent multilingual pre-trained models perform poorly on multilingual retrieval tasks due to lack of multilingual training data. |
| Approach: | They propose to mine and generate self-supervised training data based on large-scale unlabeled corpus and introduce query generator to generate more queries in target languages for unlabed passages. |
| Outcome: | The proposed method performs better than baselines on a Mr. TYDI dataset and an industrial dataset from a commercial search engine. |
DuReader-Retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search Engine (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing datasets for non-English passage retrieval are lacking in quality and accuracy. |
| Approach: | They present a large-scale Chinese dataset for passage retrieval . they reduce false negatives by manually annotating results pooled from multiple retrievers . |
| Outcome: | The proposed dataset reduces false negatives in development and testing sets and removes similar training queries. |
Domain Adaptation for Conversational Query Production with the RAG Model Feedback (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have focused on human-annotated search queries but they can not cover conversations of various domains. |
| Approach: | They propose a domain adaptation framework that uses retrieval-augmented generation to improve the model's robustness. |
| Outcome: | The proposed model is more robust and performs significantly better in a more challenging setting over strong baselines. |
Craw4LLM: Efficient Web Crawling for LLM Pretraining (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing work discards over 90% of the raw data collected from web crawls, highlighting the inefficiency of current web crawlers in collecting LLM pretraining data. |
| Approach: | They propose a web crawling method that leverages the preference of LLMs as the priority score of the web crawler’s scheduler to obtain high-quality pretraining data. |
| Outcome: | The proposed method achieves high-quality pretraining data on a web graph containing 900 million webpages from a commercial search engine's index with just 21% URLs crawled. |